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ABSTRACT 

Testwiseness (TW). and its effect on the reading 
comprehension scores in four ethnic populations (Black, Hispanic, 
Native An^erican, and Anglo) from the Tucson Unified School District 
weire investigated. Inservice-trained teachers presented seven 
classroom TW teaching and practicing sessions of J.5 minutes each to 
students in grades 3, 5, and 7. Students w^ere administered the Test 
of Testwiseness; they were pretested and posttested with the Reading 
Compreliension subtest of either the California Achievement Tests 
(grades 3 ^and 7) or the Comprehensive Tests of Basic Skills (grade 
5). Differential reading ability and socioeconomic level, both 
variables highly correlated with testwiseness, were statistically 
controlled; It was found that (1) no ethnic group posses.sed a 
significantly greater or lesser amount of testwiseness when different 
reading ability and socioeconomic levels were controlled; (2) when 
instructed in testwiseness, gains appeared comparable among ethnic 
groups; and (3) the amount of testwiseness training did not appear to. 
affect reading comprehension scores on a standardized achievement'' 
test. (Author/PN) 
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ABSTRACT 



This S'tudy fills a need in the'research literature on test- 
wiseness. because it focuses on (1) possible ethnic group differences 
in testwiseness, (2) possible differential gains of ethnic groups , 
in testwiseness after instruction, and (3) possible effects of 
testwiseness on reading achievement test performance. This study 
included in its sample - Native American, Black, Hispanic and Anglo 
students in the^ third, fifth and seventh grades. Differential 
reading ability and socioeconomic level, both variables highly - 
correlated with testwiseness, were statistically controlled. 

Among the sal ient findings were the following: (1) No ethnic 
group possessed a significantly greater or lesser amount of test- ^ 
wiseness when different reading abil ity and socioeconomic levels 
•were controlled, (2) When instructed fn testwi sene%g , gains appeared 
comparable among ethnic groups, and (3) The amount of testwiseness 
training did nOt appear to affect reading comprehension sqores on 
a standardized achievement test. 
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INTRODUCTION 



The public's interest in testwiseness has been growing 
while^ articles in recent newspapers and journals depict this 
heightened interest. The Arizona Daily Star (1981) reported, 
"100 school^ districts joi'n test-help plan". The Dallas 
T.imes Herald (Austin 1981) proclaimed, "Teachers pressured^o 
teach test-taking skills". The American School" Board Journal 
(Gifford and Fluitt, .1980) carried the article, "How to make 
your students test-wise", and tKe Jourjial of Reading carried 
an article by the Assistant Provost at the University of 
Maryland at College Park (McPhail, 1981), arguing for the 
teaching of test-taking skills. ' ^ 

'Testwiseness (TW) was first identified as a possible 
effector of reliability by Thorndike (1951). A viable conceptual 
framework for this construct was provided by Millman, Bishop, . 
and Ebel (1965) whose definition of TW is employed in this 
study: 

a subject's capacity to utilize the characteristics 

and formats of the test and/or the test taking 

situation to receive'a high score. , . 

Researchers have shown that TW can be measured (Gibb, 
1964; Millman, 1966; Slakter et a1 . , 1970a; Woodley, 1973; 
Bajtelsmit, 1975a), that TW can be taught (Gaines and Jongsma, 
1974.; Sarnacki, 1979), and that training, in TW skills improves > 
perfoy^mance on tests designed to measure TW (Gibb, 1964; Slakter 
et a1., 1970a; Moore, Schutz, and Baker 1966; Langer et a].;i973) 
More relevant to the purposes of this study, researchers have 
shown that instructions in^W raises the scores of students 
measured on standardized tests such as the Comprehensive Tests 
of Basic Skills (Gaines and Jongsma, 1974), the Stanford Reading 
^Testi(Cai1"erTbach,--1973), the MetropoAl tan Readiness Test 
(Oakland, 1972). 



Gibb (1964) argues that individuals p6ssess different 
amounts of TW, and Sarnacki (1979) asserts that students high 
in TW may more-^ .profitably employ their skills. He further ^ 
contends that individuals low in TW are penalized and handi- 
capped for lack of such abilities (Sarnacki, 1979). Since 
students differ in the amount of TW which th^y possess, it is 
also likely that different ethnic. groups will possess varying 
amount of TW^. 

Major reasons for t;he need of this study are the following: 
(1) Ethnicity has not been used as an independent variable in 
the study of TW, and (2) the Tucson Unified School District 
(TUSD) is one of the few school districts in the United States * 
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where large number of Blacks, Hispanics, Native-Americans, and. 
Anglos can , be tested in TW. If graups not skilled in JW are 
penalized as Sarnacki (1 979) contends, a'nd if minority groups 
posscis different amounts of TW, then they are penalized and 
handicapped for the lack of these skills. Students above 
average in TW may be over-rewarded, too. Since standardized 
tests are used "to evaluate student performance, and to assign 
students to varied education projects, then those students 
lacking in TW will be incorrectly evaluated and incorrectly 
assigned to such educational projects as a result of lack of 
TW skills. 

.'Tests of TW have been developed by Gibb (1964), Millman 
(1966), Slakter et al . , (1970a), Woodley (1973), and Bajtelsmit 
(1975a). These measures will be examined carefully in prepara- 
tion for the present study. 

If, indeed, students are penalized for lack of TW, or • 
rewarded for possession of TW, and this ability is related to 
ethnic background, then there are ethnic groups penalized in 
the American educational system for lack of TWaSkills. Further, 
if it can be shownthat TW can be taught to ethnic groups lack- 
ing TW, then deficiencies in TW can be remedied. 

The general purpose of this project is to investigate the 
amount' of TW in four ethnic populations. (Black, Hispanic, Native- 
American, and Anglo) and how TW affects the reading comprehension 
scores of these four populations. This study will address the ^ 
following research questions which focus on minority group popu- 
lations:. (1). Do Black, Hispanic, Native-American, and ^ . 
.Anglo students possess different dnjounts of TW skills? (2) Will 
Black, Hispanic, Natf ve-American , or Anglo students make greater 
gains from pretestHo posttest on TW skills? (3) Will there 
be differences between treatment and control groups on reading 
comprehension at Grades 3, 5, and 7 after instruction in TW? 
(4) Will there be differences between treatment and control 
groups on testwiseness at Grades 3, 5, and 7 after instruction 
in TW? (5) Will Black, Hispanic, Native American, or Anglo 
students make greater gains in reading comprehension after ac- 
quiring TW skills? (6) Will third, fifth, and seventh grade 
students make different gain^s in acquiring TW skills? 
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METHOD 



Sample Selection - 

Five junior high schools were selected from the Tucson 
Unified School District because they represented a cross- 
section of socioeconomic (SES) areas and their enrollment 
consisted cf large number of" minority groDps. Thirteen . 
elementary schools were selected foV this study for the same 
reasons.' At each school teachers were asked to voluntarily 
participate in this National Institute of Education funded 
study of TW. Although grades 3,5,7 and 8 were, represented 
in this study, results are reported only for grades 3, 5 
and 7. Refer to Table 1 for the names and grades of parti- 
cipating schools. 



Table 1. Schools and Grades Participating i.n Testwiseness Study 



School Grade 



A. Elementary Schools 

Cavett ' 3 

Gorbett • , . ^ :^,5 

Davidson 3 

Drachman ^ ^ 3,5 

Holladay . . 5 

HoUinger 3,5 

Lawrence 3,5 

' Lynn- .. , " 3,5 

Pueblo Gardens . 3,5 

Rose 3,5 

Safford ^ ^3,5 

Van Buskirk 5 

White - 3,5 

B. Junior High Schools 

Doolen - 7 

fJaylor * - 7,8 

Pistor * ^ 7 

Safford - 7,8 

Wakefield ' 7,8 
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A total of 854 students (720 students in treatment groups; 
134 students in, control groups) participated in this study 
representing a total of 56 classrooms and 32 teachers. Further 
information on treatment and control groups is presented in 
Table 2. The combined grades consisted of 5 percent Native 
Amci^icans, 7 percent Blacks, 53 percent Hispanics, and 35 
percent Anglos. Males comprised 52 percent of the total group 
and females 48 percent. r^^"^ " 



Table 2. 


Treatment and Control Groups 
Testwi seness -Study* 


Parti cipatinq in the 




Grade 


Treatment 
Classes" Students' 


Treatment . 
Classes Students .. 


Total 
Students 


3 


8 


154 


3 


49 


' 203 


•5 


9 


1 8.6 " 


' 2 


30 


216 


7 


17 


255 


4 


55 


^ 310 


8 • 


13 


125 






125 


TOTAL 


47 


■ 720 


9 


134 


854 



*Only students present for both the pretest and posttest with the 
Test of Testwi seness (TOT) are included in these figures. 
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Instrumentation 



'J ' ' . • ■ 

1 \ Test of Testwi seness (TOT) : The TOT was adapted from a ^ 
test of testwi seness developed by ^lakter et al . (1970a7. 
The adapted test contained 16 items measuring four major 
aspects of testwi seness . Only the total score was- em- 
• ployed in the analysis^. This adapted tes't was written 
^siiiigly so as -to be understandable to students who were ' 
- ^ suspected of having limited reading ability.- The same 
test was administered, as a pre and posttest. 

The JOT was adapted, for this study by the principal 
investigator and^the consultant to the project from a 
previous test of ^ testwi seness developed by Slakter a.nd 

"his associates (Slakteif^, Koehler, and Hampton, 1970b). 
in fact, the TOT so closely paralleled the Slakter et al . 

"scale that it might b,e considered on elementary l,evel of 
their test. Four aspects of TW„were used in the construe-- 
tion of th)5 TOT. These aspects were chosen from categori.es 
d'escribed by Millman et al (j 965) . These same categories 
have been selected by other researchers because they were 
capable of being conveniently measured (Slakter et al . , 
1970). The four aspects selected from Millman et'al. 

, (1965) were: 

^ The examinee should be able to (1)' Select the option 
which resembles an aspect of the stem, (2) Eliminate options 
which are known to be incorrect and to choose from among th^ 
remaining options, (3) Eliminate similar options, i .e.., 
options which imply the correctness ^of-each other, (4) Elimi- 
nate those options which^'incl ude specific ,determi ners . 

J 

Items were constructed in such a way that the keyed 
responses could not be' arrived at by knowledge of the subject 
matter. The final form of the scale consisted of 16 item's 
with 4 items designed to measure each of thesfour categories 
selected, from Millman et al. (1965). Since the TOT was in- 
tended to be adijiintsteTed to students in the third i fifth, 
arild seventh grades , many of whom were suspected of low readinn 
ability, the TOT was written with a simple^vocabulary . 

2. Reading Comprehension 

A. Third Grade: The California Achievement Test (CAT), 
Level 13, Reading Comprehension subtest was administered 
as a- pretest (Form D) and as a posttest (Form C). This 
subtest consisted of 27 multiple choice' items. ^ \ 

B. Fifth Grade: The Comprehensive Tests of Basic Skills (CTBS), 
Form S, Level 2, Reading Comprehension Test Was administered 



as a pretest. The CAT, Form C, Isevel 15, Reading 
Comprehension Subtest, was admini'stered as a • .. • ' 
posttest. ' The CTBS, Reading Comprehension Test 
consists of 45 items; The CAT Reading Comprehension 
. , subtest consists of 40 items. ■ ' ' 

C. Seventh Grade: The C^T, Form C, Levdl 17, Reading 
Comprehension subtest, was administerecj j^s both 
a pretest and a posttest. 

3. ■ ^Socioeconomic Status (SES)? SES was measured by parti ci- 

pati'on in the Free Lunch Program for Low Income Children. 
These- participants were coded with 1 ; 'the others .were 
cod.ed 0. ' 



ProcBdurie 

During the Week of November 10, 1980, five inservices . 
were held in widely-separated areas of Tucson in order ^o 
provide small inser\/ice meetirtgs. for teachers who vol unteered 
to participate in the-lTe^twi seness Study. These meetings did • 
not last more than. one hour. The followi-ng weel<?^, the week of'' - 
November 17, five more inservices were held in various geographical 
areas of Tucson. Like the meetings %he previous week, these meetings 
did not exceed one hour. Participating teachers attended one meeting 
the week of November 10 and one meeting November 17. Trans-' 
parencies which presented TW. or.inciples were projected on a 
screen and discussed. An outline of each Irieeti ng and copies ' 
of the^^ransparencies are presented in Appendix 1. 

_ - -^^ - . ^ - - " .. . . ^ 

The emphases of the inservice meetings were the four elements 
of TW described by Millman, 'Bishop, and Ebel^ (1965): 

Elements independent of test constructor or test purpose. 

A. Time-using strategy ^ - 

1. Begin to work as rapidly as possible with reasonable 
assurance of accuracy . ' 

2. Set up a schedule for progress through the test.. 

3. Omit or guess at items which resist a quick response. 

4. Mark omitted.. items, or items which could* use further 
\. consideration, to assure easy relocation. 

5. Use time remaining after completion of the test to 
reconsider answers. 



; ■ - . 

B. Error-ayoidance strategy. . 

1. Pay' careful attention to directions, ^determing clearly 
the nature of the task and the intended basis for 

^ 'response . ^ ^ ■ 

2. ' Pay caraful attention to the items, determine clearly 

the nature of the question. 

3. Ask examiner -for clarification when necessary, if it 
, 'is permitted. • ' ^ ^ . ^ - ^ 

4'. Check. all answers. ' 

C. • Guessing strategy., , 

1. Always guess if right answers only are scored. 

2. Always guess if the correctfon for guessinq is less 
severe than a "correction for guessing" formula that 
gives an expected score of zero for random responding.^ 

3. Always guess Wen if the usual correcti9n or a mdre 
severe penal ty\ for gue.ssing is employed, whenever 
elimination, of aptions provides sufficient chaace of 
profiting. . 

D. Deductive reasoning , strategy . , - ^ . 
^\ Eliminate options which are. known to be incorrect 

and choose from. among the remaining options.. 

2. Choose neither'^or both of tvvo options which imply ' 
. the corrections of each other^. ^ 

3. Choose neither or one (but Vol; b^th*) of two 'statements, 
one of which, if correct would imply the incorrectness 
of the' other. ' * * 

4. Restrict chpice to ^hose" options which encompass all of 
two or more' given statements known to be correct. 

5. Utilize relevant content information im other test items 
and options. • ^ " ' . 



Testwisenes? Instructioii began approximately December 1, 1980 and • 
'ended around MarcK 20, 1981. ' It was planned that ^each teacher would 
spend a minimum of one 15-minute session every two wee^ks teaching and 
practicirfg. TW with their students. This would total to seven classroom 
sessions of 1 5-minutes" each.. One month- after the end of the TW instruction, 
students were administered the C alifornia Achfevement^ Test on ApriT 21-24, ' 
1981 as part of. a statewide ■ achievement, testing program. The Reading 
Comprehension subtest was th.e posttest for. the present TW study. 

3 ■ r^' 
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RESULTS 



An investigation of the reliability and validity of the 
TOT was considered crucial to inferences drawn about TW and 
its effects in the present study. Jherefore, a validity study 
was conducted on the TOT to investigate internal consistency, 
stability, convergent validity, discriminant validity and sen- 
sitivity to instruction. 

\ 

.'The 'TOTJnitially consisted of 10 items "cl^signed to 
measure Risktaking and 16 items, to measure Tesiwiseness. Five 
items of the Risktaking scale focused on risktalcing while :the 
.other 5 items were filler items. With a total poV^ible score 
on risktaking of 5, the analysis reveals most of the students 
obtained the total score and in m^ny classrooms there was no 
variance. Therefore, the principal investigator and the con- 
sultant decided to eliminate risktaking frOm any ''analysis and 
focus on the 16-item TW scale. 

The internal consistency of the TOT was estimated with 
Kuder-Ri chardson Formula 20 (KR20) reliability coefficients 
computed separately at each grade using pYetest results. Next, 
KR20 coefficients were calculated separately for experimental 
and control groups at each grade level using posttest results. 
This v/as to avoid any student-treatment interaction resulting 
from the fact that some of the students were in experimental 
groups and others were in control groups. The median KR20 
coefficient across grades and testings was .60. Stability 
coefficients over a five month period ranged from .36 to .49. - 
Further analyses indicated the TOT was-^sensi ti ve to instruction, 
and the evidence of convergent validity was satisfactory. Dis- 
criminant validity. coefficients appeared as low as should be 
expected. A cojtiplete report of the TOT validity study appears 
in Appendix 2 and a copy of the TOT is in* Appendix 3. The 
same TOT items were administered to third, fifth and seventh 
grade students participating in the TW study. In summary,' the 
TOT was deemed comparable to previous TWoScales, and its reliability 
and validity were considered satisfactory. .Only the total test 
score would be used in analyses. 

A preliminary analysis was conducted for each classroom 
participating in the present study in order to provide results 
to the participating teachers (Refer to Appendix 4). Often 
teachers remark that researcher: do not inform them of the 
results of studies which are condu^.ted with the cooperation of 
classroom teachers. For that reason, a special effort was made 
to contact all participating teachers. The findings of this 
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cpreliminary analysis, involving pre- to posttest comparisons 
of 'dependent samples using t-test with each clecsroom, indicate 
the following: 

1. festwiseness can be 'taught. 

2. Testwiseness can be taught as early as the 
third grade. 

3". A test developed to measu^e testwiseness 
win detect changes resulting from test- 
wiseness instruction. - 

4. Students will not gain in test-taking 

skills simply by maturation or development 
of other skills. However, specific instruc- 
tion in testwiseness can raise testwiseness 
ability. 

The following are the six research questions addressed by the 
present research study: 

1. 'Do Black, Hispanic, Native American and Anglo students 
possess different amounts of TW skills? 

2. Win Black, Hispanic, Native American or Anglo students 
make greater, gains from pretest to posttest on TW skins? 

3. Win there be differences between treatment and control 
groups on. reading comprehension at Grades 3, 5, and 7 
after instruction in TW? 

4. Will there be differences between treatment and control 
groups on testwiseness at Grades 3, 5 and 7 after instruc- 
tion in TW? 

5. Will Black, Hispanic, Native American, or Anglo students 
make greater gains in reading comprehension after instruction 
in TW? 

6. Will third, fifth and seventh grade students make different 
gains in acquiring TW skills? 



RESEARCH QUESTION 1: Do ^Black, Hispanic^ Native Am^vioan, and 

Anglo students possess different amounts 
of TW skills? 

The four ethnic groups were compared on their pretest TOT ^ 
scores statistically controlling for different pretest reading level 
and SES. The main effects for ethnicity in the third grade were 
not. significant F(3,121 ) = .72, 'P<. 539; nor were the main effects'. 
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for ethnicity significant at- the fifth grade, F(3J93)=1 .64, - 
p< .183; nor at the seventh grade, F(3,261)=l .36, p< .255. 
The results were consistent for all^ three grades.. Therefore, 
it was concluded that ethnic groups were not different in their 
testwiseness skills before testwisehess instruction.' 

Because of the significant variance accounted for by 
reading ability, the use of reading as a covariate was justified. 
SES, on the other hand, was only significant at the third grade, 
p< .027. Since^^SES was not significant at the fifth and seventb 
grades, it could have, been <dropped from the'analysis in order ^to 
gain greater power in compaVing the ethnic groups. Since the 
influence of SES has been documented in a large body of research, 
SES was allowed to remain in the analyses. Refer to Tables 3-5 
for greater detail on the analysis. " - 



Table 3. Analysis of Covariance on Third Grade Pretest Test of 
- Testwiseness (TOT) Scores Comparing Ethnic Groups 

A. Summary Table ^ 

Source of Variation df MS P 



Covariates: ^ . 

Pretest (Reading) . 1 90,49 27,09 .000 

SES 1 16.71 5.00 .027 

Main Effects: 

Ethnicity T 3 2.42 .72 .539 

Residual 121 3.34 



B. Adjusted and 


Unadjusted Means 


• 




Group 


N 


Unadjusted Means 


Adjusted -Means 


Native American 


7 


7.85 


\ 8.99 


Black 


15 


8.66 


9.03 


Hispanic 


63 


8.92 


'8.93 


Anglo 


. 42 


9.83 


8.77 








r 



Grand Mean =9.13 





; 




n - 






» Table 4. Analysis of Covariance on Fifth Grade Pretest Test of 
Testwiseness (TOT) Scores Comparing Ethnic Groups 

c 

A. Summary Table ' 








Source of Variation df MS 


F 


p 




• 


■ y 

Covariates: . " , 

Pretest (Reading) 1 207.22 

1 ' d Dfi 


44.19 
R6 


000 
354 




• 


Main Effects: 

Ethnicity 3 7.67 

Residual ^ 193 4.69 


1 .64 ' 


183 

•v 










IX 






B. Adjusted and Unadjusted Means 










Group " N Unadjusted Means 


Adjusted Means 




# 


Native American 4 10.25 
' Black • . 9 7.45 
Hispanic ' 106 . - 9.65» 
Anglo 80 9.86' 


"10.60 
8.54 
9.87 
9.43 




• 


O ' ■ ' 








• 


Grand Mean =9.65 


> 
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• 


G 








^ERLC 


IG -. 


\ 

V- 
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Table 5. Analysis of Covariance on Seventh Grade Pretest Test of 
Testwiseness (TOT) Scores Comparing Ethnic Groups 

A. Summary Table \ ■ ^ ■__ 

Source pf Variation df MS F 



Covariates: 

Pretest (Reading) 
SES 



1 



64.58 
.21 



18.43 
.06 



.000 
.809 



Main Effects: 
Ethnicity 

Residual 



3 

261 



4.77 
3. 50 



1..36 



:255 



B. Adjusted and- Unadjusted Means - 



Group 



N 



Unadjusted Means Adjusted Means 



Native American 
Black' 
Hispanic 
Anglo 



9 
14 
145 
99 



9.67 
10.86 

9.83 
10.38 



9.89 
11 .02 

9.98 
10.12 



Grand Mean = 10.08 
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RESEARCH QUESTION 2 : Will Blacky Hispanic ^ Ng^i.ve American or 

Anglo students make greater gains from 
pretest to posttest on TW skills? 

A three factor repeated measure's ANOVA (Ethnicity X SES 
X Time) was computed for third, fifth, and seventh grade students. 
The time factor was represented by pre- and posttesting with the 
TOT. Differential gains for some ethnic groups would be reflected 
in a time by ethnicity interaction. Such an interaction did not 
appear in the analyses. For the third grade the T X E interaction 
was non-significant, F(3,152)=.37, p< .772, nor was this two 
factor interaction' significant at the fifth grade, F(3 ,182)=1 .05 , 
p< .372 , nor at the seventh grade, F(3,216) = .56, p< .640. There- 
fore, it was concluded the gains of each ethnic group were com- 
parable across time. Different ethnic groups did not appear to make 
different gains in TW. These results are presented in Tables 6-8 
and the mean TOT scores for each^group are displayed i\n Tables 9-11^ 



Table 6. Three Factor Repeated Measures ANOVA on Testwiseness 
with Third Grade Students 



c; 

Source of Variation 


df 


MS' 




F 


P 


Between subjects 












Ethnicity (E) 


3 


22.57 


2. 


91 


.036 


SES (S) 


1 


36.98 


4 


77 


.030 


ES 


3 


.6.28 




81 


.490 


Subj w., groups 


152 


7.75 








Within subjects 












Testwiseness (T) 


1 


173.32 


62 


.87 


.000 


TE - 


3 


1 .03 




.37 . 


.772 


TS 


1 


■• .41 




15 


.701 


TES 


3 


6.05 


2 


.20 


.091 


TX subj w. groups 


152 


2.76 
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TABLE 7: Three Factor Repeated Measures ANOVA on Testwiseness 
with Fifth Grade Students 



Source of Variation 


df 


MS 


F 


P 


Between subjects. 










Ethnicity (E) 


3 


' 15.07 


1.56 


.201 


SES (S) 


1 


.03 


.00 


.953 


ES 


3 


2.62 


. .27 


.845 


Subj w. groups 


182 


9.66 






Within subjects * 










Testwiseness (T) 


1 


41.91 


11 .90 


.001 


TE 


3 


3.70 


1 .05 


.372 


TS 


1 


1 .32 


= .38 


.543 


TES 


3 


.25 


.07 


.976 


Subj w. groups 


182 


3.52 







TABLE 8: Three Factor Repeated Measures ANDVA' on Testwiseness 
with Seventh Grade Students 



Sotirce of Variation 


• df 


MS 


• F 


P 


Between subjects 












Ethnicity (E) 


'3 ' 


27 


.65 


3.19 


.024 


SES (S) 


1- 




.04 


.00 


.947- 


ES 


3 


8 


.39 


.97 


.408 


Subj w. groups 


216. 


8 


.67 






Within subjects 












Testwiseness (T) 


1 


127 


.44 


14.89 


.000 • 


TE • . 


3 


4 


.81 


.56 


.640 


TS 


1 


16 


.36 


1 .91 


.168 


TES 


3 


5 


.32 


.62 


.601 


Tx subj w. groups • 


216 


8 


.56 
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Table 9: Descriptive Statistics of Third Grade Students by 

" Ethnicity and Time (Pretest/Posttest ) on Testwiseness 



Ethnicity 




Pretest 




Posttest 


Difference 


Total 


N 


Mean 


SD 


Mean 


SD 


Means 


Mean 


Native- 


9 


8.56 


3.00 


' 10.78 


3.33 


2.33 


9.72 


American 
















Black 


21 


8.76 


2.26 


11 .52 


2.40 


• "2.76 


'10.14 ■ 


Hi spanic 


77 


8.90 


2.12 


10.60 


2.60 


1 .70 


9.75 


Anglo 


53 


9.96 


1 .85 


„ 12.07 


2.27 


2.11 


11.02 




TOTAL 


160 


9.21 




11 .22 




\ 2.01 


19.22 



Table 10: Descriptive Statistics of Fifth Grade Students by 

Ethnicity and Time (Pretest/Posttest) on Testwiseness 



Ethnicity 


Pretest 


Posttest 


Difference 


Total 




N Mean SD 


Mean 


SD 


Means 


Mean 


Native-. 


4 10.50 1 .29 


11 .25 


1,71 


.75 


10.87 




.American 














Black 


6 , 8.17 2.40 


10.67 


2.07 


2.50 


9.42 




Hi spanic 


106 9.5f5 2.48 


10.67 


2=.79 


1.12 


10.11 




Anglo 


74 9.91 2.40 


11 .80 


2.53 


1.89 


10.85 





TOTAL 190 9.66 11.12 1.46 10.39 



<'0 
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Table 11: Descriptive Statistics of Seventh Grade Students by 
Ethnicity and Time CPretest/Posttest") on Testwiseness 



Fthnicitv Pretest Posttest Difference Total 

N Mean SD Mean SD Mean? Mean 

Native- 11 10. QO 2.49 • 11.73 1.90 ^ 1.73 10.86 
American 

Black 14 10.86 1.92 11.57 2.90 .71 11.21 

Hispanic 122 ' 9.63 ' 2;45 12.28 4.24 2.65 10.95 

Anglo' 77 1 0.62 1.83 13.14 2.1 9 2.52 11.88 



TOTAL ' 224 10.07 12.50 2.43 11.29 



EESEARCH QUESTION 3: Will there be differences between treatment 

and control groups on reading comprehension 
at Grades 3y 5^ and 7 after instruction in TW? 



Stu^ents^scores on all Reading Comprehension tests (CTBS or 
CAT, Forms C or D) were converted to T-scores before analysis to 
make test scores comparable. Treatment and control groups were 
compared to determine if there were differences due to JW instruction 
Control groups were establ i shed at Safford and Pueblo Gardens 
elementary schools. Tl^e^e controV groups were compared with treat- 
ment groups at Cavett, Hollinger, Pueblo Gardens and Safford Elemen- 
tary schools. ; These treatment schools were selected because the 
percentages of students in low income categories were similar based 
on E5EA Title I school rankings. Control groups were also formed 
at Pistor and Wakefield Junior High Schools. These groups' were " 
compared with treatment groups at Pistor, Wakefield and Safford 
Junior High Schools. 

Treatment and control groups were compared on reading compre- 
>v^sion posttest scores adjusting for differences on, reacling pretest 
scarves. There were no significant differences between treatment and 
contrbJ groups at the third grade, F(l ,37)=.025 , p< .876; at the 
fifth grB^e, F(l ,63)=1 .39, p< .243; and at the seventh grade, 
F(l ,168)=1>^, p< .198. These results suggest that there were no 
differences be^een treatment anci control groups due'to testwiseness 
training. RefeKto Tables 12-14. ^ " 
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TabT'e 12. Analysis of Covariance on Third Grade Reading Comprehension 
Posttest Scores Comparing Treatment and Contral Groups. 

A. Summary Table , ' 



Source of Variation df - MS F p 

Covariate : 

Pretest (Reading) , 1 293.18 59.78 .000 
Main Effects: 

Group 1 .12 .U25 .876 

Residual 37 4.904 



B. Adjusted and Unadjusted Means 



Group N ' : Unadjusted Means Adjusted Means 



Treatment 27 35.48 35.82 

Control 13 36.41 35.70 



Grand^Mean = 35.78 
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Table 13. '^Analysis of Covariance on Fifth Grade Reading Comprehension 
Posttest Scores Conrraring Treatment and Control Groups • 

A. Summary Table 



Source of Variation 



df 



MS 



Covariate:" 

Pretest (Reading) 

Main Effects: 
Group 

Residual 



1 -2331 .84, 62.09 .000 

1 -52.1 2 1.39 .243 
63 37.56 



B. Adjusted and Unadjusted Means 



Group 



Unadjusted Means Adjusted„Means 



Treatment 
Control 



55 
11 



43.57 
43.68 



43.19 
45.60 



Grand Mean = 43.59 



ERIC 



23 
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Table 14. Analysis of Covariance on Seventh Grade Reading 
Comprehension Posttest Scores Comparing Treatment 
, and Control Groups. 

* ) . ' . 

A. Summary Table 





Source of Variation 


* df 


MS '• 


F 




P 


'Covariate: " 














Pretest. (Reading) 


1 


5341 . 


19 


139 


52 


.000 


Main Effects: 














Group 


1 


63. 


88 


1. 


.67 


.198 


: Residual 


168" 


38. 


28 









B. Adjusted and Unadjusted Means 



Group . N • -Unadjusted Means Adjus,ted Means 

Treatment 128 47.20 47.23 

Control 43 45.93 45.83 



Grand Mean = 46.88 
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RESEARCH QUESTION 4: Will there he differences between treatment 

and control groups on testwiseness at 
Grades 3j 5 and 7 after instruction in TW? 

Analyses of covariance were used to compare treatment and 
control groups on testwiseness posttest scores adjus.ting for pre- 
test TW differences.^ These comparison-s included the same schools 
as did the comparisons for Research Question 4. However there 
are differences in sample sizes because more students were pre- . 
and posttested with the TOT. ANCOVA results indicated significant ^ 
differences between treatment and control groups favoring the 
treatment groups in the third -grade, F(1 ,85)=n .48, p< .001; the 
fifth grade,- F(1 ,63)=8.39, p< .005; and the seventh grade, F(l,168) = 
24.30, p< .001. These results indicate treatment and control groups 
were different on the posttest. These findipgs are further .supported 
by,, the preliminary cTass by class analysis (Appendix 4) in which TW 
classrooms consistently showed significa.nt gains wliereas control, 
-g r 0 up s—d-i'd-n 0"t~s-ho w-s-i-g n-i-lFiea n t-ga i n s-^-^-Ref e r- -t o--Ta b~Tes- T5 - 17^ 

^ 

Table 15. ^Analysis of Covariance on Third Grade Testwiseness 
•Posttest Scores Comparing Treatment and Control 
Groups 



A. Summary Table 





Source of Variation 


df 


MS 


F 


P 


Covariate : 












Pretest (Testwiseness) 


1 


107. 


54 


17.. 78 


-.000 


Main Effects:, 












Group 


1 


69 


39 


11 .48 


.001 


Residual , 


85 


6 


.05 







B. Adjusted^and Unadjusted Means 





Group , 




Unadjusted Means Adjusted Means 
^ 



Treatment 58 10.75 10.86.. 

Control 30- 8.96 8.97 



Grand Mean = 10.22 



Table 16. Analysis of Cqvariance on Fifth Grade Testwiseness 

Posttest Scores 'Comparing Treatment and Control Groups ^ 



A. ' Summary Table 





Source of Variation 


df 


• MS 


F 


P 


Covariate: 












Pretest (Testwiseness) 


1 


54 


52 


11 .02 


.0,02 


Main Effects; 












Group 


1 


41 


.51 . 


8.39 


.005- 


Residual 


63 


" 4 


.95 







B. Adjustegl and" Unadjusted Means 



Group N Unadjusted Means Adjusted Means 



Treatment 55 ' ' 10.83 10.76 

Control 11 8.18 8.56 . 



Grand Mean = 10.39 
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Table 17. Analysis of Cova.riance on Seventh Grade Testwisenejs 

Scores Comparing Treatment and Control Groups 

** * . ' 

A. Summary Table • ' • . ■ ■ ,,v 



Source of Variation 



df.. MS 



Covariate: 

Pretest (Testwiseness) 

Main Effects: • 
Group 

Residual 



1 . 223.72 42.10 .000 

1 129.14 24.30 .000 
168 5.313 



B. Adjusted and Unadjusted Means 



Group 



Unadjusted Mean's Adjusted Means 



Treatment 
Control 



128 
43 



12.r3 
9.95 



12;08 
10.08 



Grand Mean 



11 .58 



27 
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RESEARCH QUESTION 5: Will Blacky Hispanic y 'Native American or 

Angto'' students make greater gains in reading 
. comprehension after instruction in TW? 

The^resuUs of Research Question 3 presented evidences that 
treatment and control groups were not different in reading com- 
prehension after instruction in TW. This indicated that TW 
instruction did not have an effect on standardized reading 
comprehension -test scores. If pre- to posttest reading compre- 
hension differences could not be attributed to TW ins,truction, 
then Research {Question 5 was no longer a logical part of the present 
study, and it is not presented. '^For those who are curious about the^ 
results of the analysis of Research? Question 5, reference is made, 
to Appendix 5. 



RESEARCH QUESTION 6: Will thirds fifth and seventh grade students 

make different gains in acquiring TW skills? 

'The mean gain of third grade students in testwiseness was 2.01, 
of fifth grade students was 1.46 and of seventh grade students was 
2.43. There was not sufficient .evidence to consider these gains 
significantly different. Refer' to Tables 8-10. 



\ 
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DISCUSSION 



' The present study of TW is important because it was the 
first study of TW to focus on ethnic group differences.^^ 'This 
study included four major ethnic groups: Native American, Black, 
Hilspanic and Anglo. Furthermore, Reading Comprehension and 
Socioeconomic Status, which were selected as control variables, 
were most crucial in the study of TW because, research has shown 
that these three variables are highly intercorrelated and easily 
confounded, - 

The logic of this study was based 'on two premises from 
whic^h inferences were drawn about possible ethnic group 
differences: (1) The Test of Testwiseness (TOT) was an 
adequate measure of testwiseness, and (2) the testwiseness 
instruction was effective. Evidence from the validation 
analysis of the TOT indicated the. TOT was adequate. Treat- 
ment and control group compari sons >tlemonstrated the testwiseness 
instruction was effective./ 

The results of the present study did not show the effects of 

TW on Reading Comprehension scores of the CAT. Treatment and control 

groups were not significantly different. Several factors may account 
for such a finding: ^ 

(1) Each teacher received only two hours of TW injstruction'and they ~ 
provided a minimum of one hour and forty-five minutes total 

time across four months, from December through March, in the 
instruction of TW. There simply may not have been enough 
instruction- of the teachers, and the teachers may not have|^ 
spent enough time instructing the students. * ' 

(2) The focfus of instruction was on the following aspects of TW: 
(a) stem-option resemblance^^ (b) elimination of incorrect or 
absurd options, (c) el imination of ^similar options, and (d), 
elimination of options, with specific determiners. These 
aspects of TW appeared to have been removed from ^the Cal i fornia 
Achievement Test . Thus, it may be inferred that test specialists 
who develop standardized tests may identify and delete' such TW 

• clues during the test construction process. : * 

Two salient findings resulted from the present research: Before 
instruction in TW, the ethnic groups were not different in the amount* 
iof TW:they possessed jvhen 'differential reading abilities arid SES. were. 
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controlled. This was found at the third, fifth and seventh grades. 
This finding was particularly convincing because different' reading 
abilities and SES levels were control led. Unless reading and SES 
are^ controlled, these variables will confound any ethn'ic group 
comparisons because reading abilities of minority students are 
often lower than that of Anglo students, and. minority students 
often are of a 'lower SES level than Anglo students. In fact, 
in the analysis of Research Question 1, it was found the four 
ethnic groups were significantly dif-ferent in their reading 
ability. If reading ability v/ere not controlled, one might 
discover significant differences among ethnic groups on TW and 
not realize that the difference is due to Readinq Comprehension 
or SES. . ^ ^ 

Another finding is that when ^instructed in TW, ethnic groups 
made comparable gains ffom pretest to posttest. Such comparable 
gains are rarely found in achievement testing in reading and 
mathematics. Thus, not only does this research find evidence - 
that ethnic groups possess comparable TW skills, but it also finds 
that when instructed in TW, different ethnic groups appear to make 
comparable gains in the acquisition of TW skills.- 

One purpose of the present study was to investigate the amount" 
of TW in four ethnic groups.- It has been argued that if ethnic 
groups possess different amounts of TW, then those with less amounts 
of TW will be penalized in the American educational system.^ It has 
also been argued that if there are deficiencies, then any penalizing 
call be overcome through instruction. The present study has shown 
that different ethnic groups do not possess significantly different 
amounts of TW, .and when they are instructed ^in TW, they make com- 
parable gains : ' ' 
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APPENDIX 1 
Testwiseness Instruction 



•eric 
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National Institute of Education 

The Effect of Testwiseness on^the 
Reading Achievement Scores of 
- Minority Populations 

Week of November 10, 1980 

3:15 p.m. to 4:15 p.m. 

Principal Investigator^: Dr. Stephen Powers Phone -6138 
Project Consultant:' Dr. Darrell Sabers 

Outline 

1. Schedule of Sessions 

2. Teacher-Class Information 

3. Overviev/ of the Project . . 

4. What is testwiseness? . 

5. Testwiseness Pretest: Critique 

6. Control Groups 

7. Third Grade Teachers: Third Grade Readinq Test 
Next week: Methods of Teaching Testwiseness 
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Department of 
LEGAL and RESEARCH SERVICES 

Division of PLANNING, ANALYSIS and MANAGEMENT 



TO 



Participating Teachers in the 
NIE Testwiseness Study 



FROM 



Stephen Powers, Principal Investigator 

NIE Testwisness Study, Legal and Research Services 



SUBJECT: National Institute of Education's Testwiseness Study 

Thank you for your volunteering to participate in the NIE Testwi seness" Study . 
Two one-hour meetings are planned after school during the weeks of November 10 
and November 17. Each week you may choose one meeting to attend at any of the 
five schools. All the presentations on testwiseness during the week of 
November 10 will be identical. The same will be true of the presentations 
during, the week, of November 17. The locations and times of presentations on 
testwiseness are presented below. The numbers of participants at each session 
' are expected to be between '5 and 15. 



ERLC 



Week of November 


10: What is 


testwiseness? 








Day 


Mon. 


Tues . 


Wed . 


Thurs. 


Fri , 


Date 


10 


11 


12 


13. 


14 


School 


Doolen 


Naylor 


Safford 


Wakefield 


Pistor 


Time . 


3:15 


. 3:15 


3:15 


3:15 


3:15 


Room 


44 


79 


Library 


Li-brary 


Science 








on 


West side 


Room 


Week of November 


17: Methods 


„of teaching testwiseness 






Day 


Mon. 


Tues. . 


Wed. 


Thurs. 


Fri . 


Dat? 


17 


18 




20 


21 


School 


Safford 


Wakefield 


Pistor 


Doolen ' 


Naylor 


Time ' 


3:1& 


3:15 ' ^ ' . 


3:15 


3:15 


'3:15.> 


'Rdom. 


Library 


Library 


Science 


• '44 " ^ • • 


79- 




on West side 


Room 








- Tucson 


Uj^i'i^itd Scho 


0 1 District 







Participating Teachers in the 
NIE Testwiseness Study 
October 24, 1980 
Page 2 



Dr. Darren Sabers, the project's consultant, and I are looking .forward to 
meeting you at these tv70 sessions. We have prepared a packet of materials 
on testwiseness and testtaking skills which will be presented to you- as 
professional reference material. Moreover, we have adapted the essentials 
of testwiseness for a presentation to you. . . 

For your interest, I have attached a- list of participating schools.- 
If I can be of any assistance, please call me at -6138. 



SP/ch 
10/24/80 




Attachment 



Copies to Principals 

Darrell Sabers 
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NIE Testwiseness Study 1980-81 
Participating Schools 



Junior High Schools 

Doolen 
Nay lor 
Pistor 
Safford 
Wakefield 



EleHientary Schools 

Cavett 
torbett 
Davidson 
Drachman 
' Holladay 
HoUinger 
Lawrence 
Lynn 

Pueblo 'Gardens 

Rose 

Safford 

Van Buskirk 

White 



TUSD LfiR 

SP/ch 

10/24/80 



NIE STUDY OF TESTWISENESS . 
TEACHER-CLASS INFORMATION FORM 

1. NAME " ' 

2. SCHOOL , 

3. ELEMENTARY SCHOOL TEACHERS: Approximately, how many students 
are in your class who will receive testwiseness instruction? 



:> 
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4 . JUNIOR. HIGH SCHOOL TEACHERS: In wha;t class periods will you give 
testwiseness instruction? Approximately , how many students are 
in each class? What subject is taught in each class? Fill 
in your answers^ hel^wi 

Period , Subject . >. Approxima:te number 

' • of students 



5. SPECIAL ASSIGNMENT TEACHERS: If .you are a teacher of learning 
disability studen-£s> gifteid students, counselors, or other 
responsibilities, please state what your educational assignment 
is; • ^ 



Thank you 



Steve Powers 
11/10/80 , 



A 



OUTLINE 'OF TESTMISENESS" INSTRUCTION 

Research Funded by NIE : The Effect of Testwisenfess on the Reading Achievement 
Scores of Minority Popul^aftion. Many people •interested.''' 

Describe the Research (iricluding control group and SES) 

Hand out TW Tests and Information Sheets ; 

Theory 

Definition: "a subject's capactiy to utilize the characteristics and formats 
of the* test. and/or the test-taking situation to receive a high score" - Millman, 
Bishop and Ebel (1965) 

A) TW is independent of the examiner's knowledge of the subject. 

B) .Correlated with testtaking experience (limited amount of practice only). 

C) Negatively correlated with time (eroded with time). Adults appeared 
deficient in TW. 

D) Moderate positive relationship. with intelligence. 

E) High correlation with verbal achievement. . 

F) Negative correlation with test anxiety, ^ 

G) No relationship with sex 

H) Correlation with grade level. Linear trend 
Research . - 

A) Can be measured 

B) Can be taught 

C) Training in TW skills improved performance on TW tests 

D) Training in TW skills improve performance on. teacher .tests 
El Training in TW skills improves performance on standardized tests 

F) Students high in TW more profitably use their skills 

G) Students ;low are penalized ^' , ' 
J Students scored higher^when : . . \ ' 

1) Time limit removed ' 

2) Received verbal praise and encouragement 

3) Tests labeled a game and in a game group 

'\ 37 ■ 
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students jscored higher when j ^(.contd.) ' . 
4) An IQ- test instead of achievement test 
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• 




5) Reinforced for correct ansv/ers 

6) When** instructions ar^e clear 








Test-Taking Skills " . ' . 






• 


.1) 
2) 


Teacher influence: prepare room,, explain clearly, etc. 

Gfeneral Strategies ' ^ 










A) Ansv/er ALL questions " . 


• 




• 


\ 


B) Don't be a quitter 

C) Follow directrons 

D) Don't look for a pattern . . 










E) Ask questions if you don't understand 

F) Use time wisely 






' 


3) 


Testwiseness Skills 










A) Stem option resemblance 

B) Elimi.nate similar options, v 






• 




C) Eliminate absurd optidn, then answer lo the best of your ability, 
remaining options , 

. . r • ' . 1 

D) Avoid specific determiners / 


the 




• 


t 


t ' ' ' 
^ ' ' ' • » 












\ * 




• 


* " ' * ■ 

TUSD L&RS ' • 
SP/se 

"2/18/82 •-. , ^ ' '.. 
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NIE Testwiseness Study 
Week of November 17, 1580 
3:l3^p. m. to 4:15 p.m. 



• AGENDA 



1. 


•Review of TW Principles (slides) 




2. 


Overview. » ...^ 




3. 


Testwiseness 




4. 


NIE Testwiseness Study 




\5. 

%: 

i. 


Practice Items 
Stand ar d i z e d "T e st*s 
Control Groilps 






Discuss the TW test which will be sent to 


teachers 


Discuss methods of teaching TW 




lb. 


vTips on Discussing Testwiseness (TW) with 


children 




x 

\ 



SP/ch \ 
11/17/80 \ 



NIE Testwiseness Project 



OVERVIEW 



The testwiseness instruction begins approximately 
December 1, 1980 and ends around March' 20, 1981. It is 
hoped that participating teachers will spend a minimum 
-of one 15-minute session every two weeks discussing and 
practicing testwiseness skills every two weeks while 
school is in session. This would mean one session in 
December, two sessions in January, two sessions in Feb- 
ruary and two sessions in March. This will make a total 
of seven instructional sessioris. If participating teach^ 
ers wi^^>to give longer instruction in testwiseness they 



Statewide achievement testing of. students in Grades 
1-12 in reading, mathematics and language arts will be 
conducted in Tucson Unified School -District April 21-24, 
1981. It is hoped that the teachers participating in the 
testwiseness study have given their students special prep 
aration for the statewide testiTig so that they may apply 
many of these test-taking principles. 



may. 




SP/ch 
11/17/80 




Testwiseness 



Testwisehess is ''a subject^ s capacity to utilize the char.ac- 
teristics and formats of the test and/or the test-taking 
-s-i-tua4ion— reeel-ve--ar^^i-^h~ - 

The following are some of the items w& have already discussed 

1. .Principle: Avoid Specific Determiners 

The Dakstan desert is 

A. always hot in March.- 

B. never windy tn May. - . 

C. sometimes temperate 

. D. only cold i'n December. * • 

2. Principle: Eliminate Similar Options 

Bendaline '.s. opera 'The Three Bells'^ is about 

A. marital problems. 

B. domestic strife. 

C. the problem of aging. 

D. the conflict between an old man and his wife. 

3. Principle: Stem-Option Resemblance / 

Which of the following instruments measures self-esteem? 



A. The Campbell Interest Test / 

B. The Kidder Preference Inventory 

C. The Vassey IntelTigence Scale 

D. The Utah Self-Concept Scale 



4. Principle: Eliminate Absurd Ont ions 



America's most popular sport is 

A. , sewinj;. 

B. baseball. / 

C. reading. - 

D. knitting. / 



/ 



sp/ch ;ii 

11/17/80 I 



NIE TESTWISENESS STUDY 

1. Teacher Influence : Prepare room, explain clearly, 

2 . General Strategies 

a. Answer All Questions 

b. Don ^ t be a quitter . 

c. Follow Directions 

d. Don't look for a pattern 

e. Ask questions if ypu don ^ t understand 
' f . Use Time Wisely 

3. Testwiseness Skills 

a. Stem option resemblance 

b. Eliminate similar options 

c. Eliminate absurd options, then answer 

best of your ability, the remaining 

d. Avo.id specif ic determiners 



to the 
options 



TUSD LSiR 
11/13/80 
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De,pa*rtm.ent of 



LEGAL and RESEARCH SERVICES 



Diviaion of PLANNINGi ANALYSIS and MANAGEMENT 



/ 



TO: 



Teachers in the Testwiseness Study 



FROM: 



Stephen Powers, Principal Investigator 
NIE Testwiseness Project 



SUBJECT: Practice Testwiseness Items 
Enclosed are the following: 

A. Practice items for teaching your students many testwiseness skills. These 
items are categorized as J 

1. Stem-Option Resemblance, 

2. Specific Determiners, 

3. Absurd Options, and . , 

4. Similar Options. - 

The grade levels for these items vary from third to seventh grade. Many of 
these items you will want to reword to make them more relevant to your students 
ability level. Feel free to make any changes you feel are needed'.^ 

B. A summary of the testwiseness principles. \ 

C. A summary of testwiseness strategies and skills. 

If I can be of any assistance, please call me at -6138. 



SP/ch 
.1/7/81 
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Tucaon Unified School Diatrict 



Testwiseness Practice Items 
The correct response is starred. The similar words are circled 

T. Stem-Option Resemblances: 



'A ( ^rtentlj in-needHs- - 

1 . John's brother 

2. the banker 

3. a policem an 
*4. a ( friend ) indeed 



The story "The (mrtoise^ The Hare" is about 

1 . racjjTK 

*2. a C tgftoi se] who wins a race 

3. rabbits 

4. animal crackers 




(Cactus) wrens build their nests in 

Bird houses 
mesquite trees 
$ahuaro( ^actii? ) 

Which of the following i s a (^ Tnosaia) ? 

*A. Bronto^aurusj 

B. Elephant 

C. Pithicantropus 

D. Neanderthal 



The(fire)ant can be identified by its 

A. ^ large pincers 

B. armored appearance 

* C . lonal^l^. 

*D. (FrigFTt r jd_color) 

The short, story, "Life in An (EsH^o) Village" was written by 

A. a person who traveled in the Northwest 

B. a professor who teaches mathematics 

C. a thlM grader at Smith Elementary School 
*D. an (EskTmo) who lived in Alaska 



The story (^A^rip^ about ' 

A. GeorgeJiiasfiin childhood 

*B. (a ^rain ride) 
C. dinosaurs 
, D. the 'bakery , 
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Stem-Qption^ Resemblances (contd.) 



To botheir the (neighbors) means to 



AL insult your friends 
*B. disturb the (n eighbors ^. 
C. disrupt the ga me ; 



shout in the woods 



The proper ^^a^) is the 

*A. correct (Way) 

B^-,„^easiesLt^nsj/var,.. 



C. best road 

D. fastest player 



He intended (to .work)means that he had 



A. taken a job 
. V B . _ p_1 anned a vacati on 
*C. decided (to workj 

D. started working 



In Qfder to ( change) an answer you should 

A. ' mark another- response 

B. make two maY^oft^,,, 

C. eras£^ll marks 
*D. (^ange)your mark 



The(mountaTnjcabin is 

*1^. on (Mount) Rushmore 

2\ on the low. desert 

3. in the valley 

4. on the Great Plains 




43 



Testwiseness Practice Items 



The correct answers are starred. ^-The specific determiners are underlined. 
"2 . Specific Determiners : 



A wicked king is 

A. " alv/ays rich 
*B. sometimes kind 

C. never wise 

D. always happy 



A fast boat 

1 . always wins a race 

*2. sometimes is big 

3. is never small 

4. only has one driver 

Billy's best friend . ' " ' ' 

1. never argues with him 

2. alv/ays agrees with»him 
*3. is often late 

4. only 1 ikes^ candy 

Japanese children 

A. ' always wear uniforms 

B. never eat beef 

C. eat rice only at dinner 

*D. sometimes go on field trips • 

Seeds are different from eggs because 

A. they always grow in the ground 

B. their husks can never be eaten 

*C. they are produced from plants instead of animals 

D. all of them can be eaten 

People who eat well 

A. always get fat 

B. * spend all of their time cooking . 
*C. usually don't need vitamins 

D. never get sick 

Learning how to drive at night is 

A. never as easy as learning in the daytime 

B. always a strain on the eyes 

*C. sometimes harder than driving in the daylight ^ 
only useful if the person plans to drive at night 



2. Specific Determiners (contd>): 
A modern computer is 

*A. sometimes useful in solving problems 

B. always reliable 

C. the only way to gather information 

D. U5ed only by computer scientists 

An airplane mechanic 

1. never flies in a plane 

*2. somletimes travels by plane 

3. only travels by car 

4. always . 1 ikes .his woi^k 

A wild horse 

1 . never can be tamed 

2. always runs with other horses 

3. only rests at night 

4. none of the above 



The student should learn to 
respond to "none of the above" 



Testwiseness Practice Items 
The correct options are starred.* 
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3. Absurd Options: 



NOTES 



Tom's pet Herman is 

1 . an elephant 

2. a c1ov/n 
*3. a tortoise 

4. a go-cart 



Choices 1, 2, 4 are absurd 



Hot means 

*A. warm 
B. cold 



C. 
D. 



sweet 
rouqh 



Choices B, C, d are absurd 



Six minus two equal s 

A. eight 

B. twelve 
*C. four 

D. twenty-four 



This problem mathematically is 
6 - 2 = ? 

The choices A, B, D are absurd 
because they are much larger 
than 6. 



A deer is 

*A. an animal 

B. a house 

C. a barn 

D. a cat 



Choices B, C, D are absurd 



To no means 



*A. 
B. 
C. 
D. 



to leave 
to study 
to laugh 
to work 



Choices B, C, D are absurd 



Where was the first United States Mint? 

A. in Germany 

B. in Berlin 

C. in Europe 

*D. in Philadelphia 



Choices A,* B, C are absurd 
because they are not in the U.S 



If you water your grass, 

A. it wi11 die 

*B. it win grow 

C. it burns 

D. the weeds die 



Choices A, C,' D are absurd 
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3. Absurd Options (contd.) : 



NOTES 



The man v/ith many cats 

A. is a workman 

B. likes to study _ 

" — C:: — fs a good frtenci of John 
*D. is an animal lover 



Choices A, B, C are unrelated 
or absurd ' 



A silly idea is 

*A. ^ foolish 

B. good 

C. strange 

D. new. 



Choices B, C, D are absurd 



Where is the Statue of Liberty? 

*A. in the United States 

B. in France , 

C. in Spain 

D. in Russia 



Choices B, C, D are absurd 
because they are not in the U.S 



Alaska is a bigger state than Texas because 

A. it was- added to the U.S. at a later time 

*B. there are more square miles of i% 

C. there are more people in it 

D. there is a greater distance between cities 



Choices A, C, D are absurd 



The pioneers traveled by 

A. Toyota 

B. plane 

C. bus 

*D. covered wagon 



Choices A, B, C are absurd 
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Testwiseness Practice Items 

.... 11 ^ 

The* correct options are starred. 
4> Similar Options :, 
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NOTES. 



-i^Q— frrvTte a frie nd mea rts- 

1. fast 

2. quick 

- 3. speedy 
*4. ask 



-&he-i-ee s 1,2,3 Qr e-s4m-i4xt-r- 



During the storm the lake v;as 

1. silent 

' 2.^ quiet 

3. still 

4. peaceful 
*5. turbulent 



Similar Options--the students- 
should be able to eliminate four 
oDtions and get the answer 
correct without knowing the 
word "turbulent." 



Where did Joe's mother take him to ride 



A. into the city 

B. down town 

C. to main street 
*D. in the country 

Darin's pet is a 

1. tortoise 

2. turtle 
*3. puppy. 



A, B, C are similar 



1 , 2 are similar 



Where is the Golden Gate Bridge? 

^ A. in the United States 

B. in New York 

C. In New York State 
*D. in San Francisco 



A, B, C are similar 



To open a Gilt box you should. hold the 
handle and 

^ twist it 
2. turn it 
*3. * pull it . 



1 , 2 are similar 



How did Bill cross the street?-^ 

,1 . he dashed across- 

— 2-r- he rushelJ across 

3, he hurried across 

*4. he walked slowly 



1,2,3 are similar 
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4. " Similar Options (contd.) : 

.Most reptiles have 

A. bright skins 

B. - many colors on their -skins 

C. multicolore d features 



*D. creep or crav/1 

Mary '5 mother 

1 . is very heavy 

2. v/eighs a lot 
*3. is rather thin 

4. has too much fat 



MOTES- . ■ 
A, B, C are "similar 



1,2,4 are similar 



. \ 
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APPENDIX 2 

The Development and Validation of a 
GrouD Test of Testwiseness 



\ ■ ■ ■ ■ . \ 

\ ■ ■ . 
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Abstract 



•The validity of the Test of Testwiseness (TOT) was inves- 
tigated at the third, fifth, and seventh grades following a 
model for construct validation proposed by Sabers and Whitney. 
The following properties of the TOT were investigated: (1) internal 
consistency, (2) stability, (3) sensitivity to instruction, 
(4) convergent validity, and (5) discriminant validity. Results 
indicated the TOT was comparatively reliable, relatively stable, 
sensitive to instruction, and able to identify pupils possessing 
testwi seness . 
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The Development and Validation of a 
Group Test of Testwiseness 

Testwiseness (TW) has been recognized since 1951 (Thorndike, 
1951) as a significant source of variance in test results. Millman, 
Bishop, and Ebel (1965) provided the classic definition of TW as 
"a subject'5 capacity to utilize the characteristics and formats . 
of the test and/or test-takinq situation to receive a high score" 
(p. 707). 

The development of the Test of Testwiseness (TOT) followed 
methods used by Slakter and his associates in their P/l scale develop- 
ment (Crehan, Koehler, & Slakter, 1974; Slakter, Koehler, & Hampton, 
1970a; Slakter, Koehler, &, Hampton, 1970b). In fact, the TOT so 
closely parallels The Slakter et al scale that it might be considered 
an elementary level of their- test. Four aspects of VA were used 
in the construction of the TOT. These aspects were chosen from 
categories described by Millman et al . (1965). These same categories 
have been selected by other researchers because they were capable of 
being conveniently measured (Slakter et aV. , 1970a). Since the TOT 
was intended to be administered to students in the third, fifth, and 
seventh grades, many of whom were suspected of low reading ability, 
the TOT was written with a simple vocabulary. Those aspects of TVJ 
which the TOT was intended to measure were described by Millman et al . 
(1965): 

The examinee should be able to 

1. Select the option which resembles an aspect of the 
stem. 

2. Eliminate options which are known to be incorrect 
and to choose from among the remaining options. 

3. Eliminate similar options, i.e., options which 
imply the correctness of each other. 

4. Eliminate" those options which include specific 
determiners. 

Items were constructed in such a way that; the keyed responses 
could not be arrived at by knowledge of the subject matter. The 
final form of the scale consisted of 16 items with 4 items designed 
to measure each of the four categories selected from Millman et al . 
(1965). 

Procedures 

The subjects for this study were pupils enrolled in the third 
(N = 203), fifth (N = 216), and seventh (N = 310) grades of the 
Tucson Unified School District during the 1980-81 school year. The 
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ethnic composition of the combined groups consisted of Native 
Americans (5 percent), Blacks (7 percent), Hispanics (53 percent), 
and Anglos (35 percent). Males comprised 52 percent .of the total 
group and females 48 percent. 

Pupils were pretested with the TOT in the fall of 1980. 
Following this, volunteer teachers were instructed in TW skills 
and methods of instruction of TW which they implemented in their 
classrooms. Students were instructed in principles of TW once 
every two weeks for a period of four months in 34 experimental 
classrooms. A total of 9 additional classrooms acted as control 
groups. Pupils were subsequently posttested with the TOT in the 
spring of 1981 . 



Resul ts 

Construct validation should include several aspects of 
reliability and validity. Related to reliability are (1) internal 
consistenc^/ and '(2) stability. Aspects of validity which should 
be examinee^ are (1) sensitivity to instruction, (2) convergent 
validity, and (3) discriminant validity. These aspects of 
reliability ^and validity were investigated following a model 
proposed by Sabers and Whitney (1976). 



Internal Consi stency 

Internal consistency, an aspect of reliability, measures the 
extent to which the items measure the same construct. The internal 
consistency of the TOT was assessed both at the pretest and the 
posttest five months later using the Kuder-Richardson Formula 20 
(KR20).. Since the treatment and control groups weredi fferent at 
the posttest time , KR20 coefficients were calculated separately 
for the experimental and control groups at each grade. The median 
KR20 coefficient across grades, pretest and posttest was .60. The 
reliability coefficients for each grade are presented in Table 1 
(see next page) . 
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Table 1. Kuder-Richardson Formula 20 Reliabilities and Test-Retest 
Reliabilities for the 16-item TOT 







Kuder-Richardson 








Formula 


20 


Test-Retest 


Grade, 


N 


Pretest 


Posttest 


Reliabilities 




• 3 


203 


.398 


(E) .612 


.49 








(C) .479 




5 


216 


• .591 


(E) .659 . 


.49 








(C) .639 




7 


310 


.425 


(E) .628 


.36 








(C) .612 





Note: Experimental (E) and Control (C) groups reliability were calcu- 
lated separately on the posttest. 



These results compare favorably with KR20 coefficients reported by 
Crehan et al . (1974) on the previous 16 item TW scale which was 
administered in Grades 5-8 in 1968 and again in 1970. The median 
reliability for the first testing, was .40 and for the second testing 
was .35. In another study, Crehan et al . (1978) reported a median 
KR20 of .40 on the 16-1tem TW scale administered to students in 
grades 5-8. 

Stability ■ 

Stability is another important aspect of reliability which 
should be considered in the development of a measure. Stability 
is estimated with the test-retest method and it reflects the degree 
to which scores for an individual remain constant over time. ^ 
Stability coefficients are presented in Table 1. These coefficients 
suggest ai relatively stable measure for a test of this length and 
type over a five-month period. 

Sensitivity to Instruction 

Other facets of construct validity investigated in this study 
were sensitivity to instruction, convergent validity, and dis- 
criminant validity. SeTisitivity to instruction reflects the extent 
to which the test can' measure the efforts to change the construct 
in question. To i nvesti gate^ sensi ti vi ty to treatment the 34 experi-. 
mental and 9 control classroom TOT means were used as units of 
analysis in pre- to posttest comparisons with dependent t-tests. 
Results are presented in Table 2. 
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Table 2. Means, Standard Deviations and ues for Experi 
mental and Control Groups as Measured with the TOT 



Group 



Number 

JDf 

Classes 



Pretest 



Posttest 



M 



SD 



M 



SD 



Thi rd 

Experimental 8- 

Control 3 

Fifth- 

Experimental 9 

Control 2 

Seventh 

Experimental 17 

Control 4 



9.2 



9.7 
8.1 



10.1 
9.7 



1 .0 
.2 



1 .1 
.9 



.6 
.6 



11 , 
8. 



11 
8 



12.3 
10.4 



1.5 
.3 



1-.1 
.6 



.8 
.6 



5.91 
-.41 



5.05 
.74 



9.72 
1 .54 



p<.001 . 

At each grade, experimental groups showed significant pre- to 
posttest gains- while control groups demonstrated no Significant 
gains. These results support the conclusion that the' TOT is sen- 
sitive to instruction in TW. 



Convergent Validity ; 

An examination of convergent -validity seeks to determine 

(1) a correlation between two measures of the same trait, or 

(2) whether a scale can discriminate between two groups expected - 
to differ on the construct in question (Vaughan & SaberS,- 1977). 
Because no other measure of TW was available to administer to all - 
the students, the cbntrasted-groups approach was used. After, 
instruction in T\«J, students in the experimental grouDS were expected 
to differ from students in the control groups on TW. Posttest 

TOT mean scores were compared after they were adjusted for pretest 
TOT mean differences using analysis of covariance. At each grade 
level, the experimental groups were significantly higher than the- 
control groups: third grade, F(1,8) = 11.48, p<.01: fifth \grade, 
F(1,8) = 5.95, p<.05; and seventh grade, F(1 ,18) = 20.50, p<.001. 
The similarity between this analysis and-that used to assess 
sensitivity to instruction is recognized, but it is the best available 
measure of convergent validity. \ 
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Discriminant Validity 



Discriminant validity is another facet which should be 
investigated. This reflects the degree to which a scale 
measures a unique construct and not merely reflecting some 
other construct. Discriminant validity was investigated by 
correlating the'posttest TOT scores with the California 
Achievement Test (CAT), Form C, Total Reading Test scores. 
The CAT was administered one month after the posttesting 
with the TOT. The correlations between the TOT and the CAT 
appeared to decrease from the third grade, .55 (p<.001); 
fifth grade, .44 (p<.001) and seventh grade, .32 (p^.OOl). 
Comparing these correlations with the TOT* s reliability co- 
efficients indicate that the TOT accounts. for only a small 
portion of unique variance at the third grade, but that 
variance increases from third to the seventh grade. Because 
the test wise students will use TW to increase their scores 
on examinations such as the CAT, the above correlations are 
about as low as should be expected... 
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Di scussion 



The present , study described the ^development and validation 
■ofthe.Test of T6stwi seness; (TOT). This test was constructed 
in order to test for testwiseness in children in the third, 
fifth, and seventh grades. The process of item construction, 
and .the investigation of reliability and validity were reported. 
The* results compared favorably with previous research on TW. For 
a scale of only 16 items, the TOT was found to be comparatively' 
reliable and relatively stable. Moreover, the TOT was able tp 
identify groups possessing TW, and it appeared to be sensitive 
to instruction. 
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APPENDIX 3 



STANDARD EDUCATIONAL TEST 



Name ° ' , 

(Last) \ .: (First) ' ' ' 

Teacher • ^ School [ v . 

Grade ' Date 

"(Month) (Day) (Year)' 
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Part I 



The examiner should read the directions to the students, 



Directions : . " ' . 

This part of the test is made up of pairs of words which have either the 
same or opposite meaning. In front of each pair of v/ords' are the le^tters S 
for "same" and 0 for "opposite". Circle the letter S if ^ the pair of words is 
the same or nearly the same, and circle the letter 0 for "bODosite" if the 
•pair of words is opposi^te or nearly opposite. 

. Each correct ans'wer will receive one point. You may leave an answer 
blank. 













s 


0 


1. 


glad 


happy 


s 


0 


2. 


sick 


. . . . ill 


s 


0 


3. 


plot, i . . . . 


. . . . frib 


s 


0 


4. 


strong. . . . 




s 


0 


5. 


hi In 


. . . . easy 


s 


0, 


6. 


funny .... 


. . . . v/aldy 


s 


0 


7. 


marnel . . . . 




s 


0 


8. 


flee. .... 


. ... fly 


s 


0 


9. 


sharp .... 




s 


0 


10. 


hot . ; . . . 


/ X . , warm 




er|c 



stop — do not go on to the next page 
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Part II 

Examiner should read these directions -to the students. 

Directions : • ^ \ 

Each of the questions or unfinished sentences in this part of the test 
is followed by four choices. You are to pick the one that best ansv/ers the 
question or finishes the sentence. Circle the letter of your choice. 

Answer all. problems even if you^are not-sure of the answer. Circle your 
ansv/ers in this booklet. Remember, answer all -problems! 
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"A Birthday Story" is about' 



A. 
B, 



plahti 
a party 
wind 
a rope 



12. The King'^ castle is 

E. 'small I' 

F. tiredj 
6.. fast I 
H. gray ; 



I 



13. V/hat happens when rilts are put in water? 

A. .heat comes / 

B. water! gets warm / 

C. v/ater get? blue / 

D. water gets hot , / 



14. In Pedro 



City 



E. sometimes the sun shines 

F'. it never rains 

G. it only rains in the sparing 

H. it always rains 

15. The flying spider 

A. can sing a song 

B. can turn green 

C. can flly in the air 

D. can kill a dog 



16. A fly hasia 

E. frib i 

F. clock! 
R. book \ 
H. cake i 



17. The story f'A Long War" is about 

A. a small boy 

B. an old Iman 

C. a short boy 

D. a littlle boy 



18. The game ofjduki is 

E. only pllyed by a king 

F. never pljayed 

G. sometimes played at home 

H . alv/ays pjlayed 




-4- 
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MorWard means 

plate 
backv^ard 
bake 
fish 



20. Why did Tim smile? 

E. Julie v/as home 

F. Joni hurt him 

G. He lost his money 

H. His TV broke 



21 . • A jimmy worm can 

A. jump 

B. hop 

C. skip 

D. eat fish 



22. At the party, the bear 

E. never eats 

F. alv/ays drinks 

G. sometimes eats fish 

H. never v/ants more 



23. The silver-leaf tree 

A. has no bugs 

B. has large leaves 

C. has shiney leaves 

D. has smooth branches 



24. A policeman carries 

E. mace 

F. an arrow 

G. a spear 

H. a sling shot 

25. A bear has 

A. big legs • 

B. furry legs 

C. large legs 

D. fat legs 

26. Early Deosophus Man 

E. alv/ays killed animals 

F. never hurt other men 

G. always lived in the forest 

H. often lived in trees 
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TEST OF TESTWISENESS (TOT) 
KEY 



Risktaking (Items 1-10) . 

Marking an answer for items 3, 5, 6,. 7, 9 indicate risktaking. 
Testwiseness j 

0 

A. Stem Option Subscale 

Items: 11(B), 15(C), 19(B), 23(C) 

B. Absurd Option Subscale 

Items: 12(H), 16(E), 20(E), 24(E) 

C. Similar Options Subscale 

Items: 13(C), 17(B), 21(D), 25(B) 

D. Specific. Determiners Subscale • 
Items: 14(E), 18(G), 22(G), 26(H) 
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APPENDIX 4 
Preliminary Findings: 

Report to Participating Teachers and Principals 



\ 
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LEGAL and RESEARCH SERVICES 
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Division of PLANNING^ ANALYSIS a&d MANAGEMENT 



TO: 



Teachers and Principals Participated in NIE Study 

of Testwiseness 1980-81 



FROM : 



Stephen Powers , Principal Investigator 
Darrell Sabers , Consultant, Department of 
Educational Psychology, University of Arizona 



SUBJECT: Preliminary Findings of the National Institute of Education's 
Testwiseness Study 1980-81 



Dr. Sabers and I are happy to send to each participating teacher and 
principal the Preliminary Findings of the Testwiseness Study 19PC-81. 
In the report there is a teacher nuraber on Tables 2-5 which you can 
compare with the teacher number on the attached list of participating 
teachers. This will tell you the results for your class. Since this is 
a preliminary report, if ^ou find that we inadvertently left the name of 
a teacher. off of the list of participating teachers, please call me at 
-6138 so that I can make the correction. Five of the teachers who began 
the TW study chose not to complete the sutyd and so their names were 
removed from the list of participants. 

We were very happy with the results of this study, and thankful for the 
voluntary participation of the teachers. Without the teacher's assistance, 
this research could not have been carried out.. 

Generally the results indicate that (1) teachers implemented very well the 
testwiseness instruction, (2), students learned the testwiseness principles 
and (3) the Test of Testwiseness (TOT) did a good job of measuring 
testwiseness. Teachers administered the TOT as=a pretest and a posttest. 
Actually the first 10 items of the TOT measured Risktaking, and the other 
16 items measured Testwiseness. From our analysis, we have concluded the 
Risktaking measure was not a valid measure, and so our analysis will be 
directed to the 16 items in the Testwiseness measure. 

Some teachers volunteered to participate as Control classe's. At" first 
this may seem as a trival participation in the study. Not so! It was 
actually a crucial part of the study, and a "part whiqh the National 
Institute of Education insisted by incorporated in the -Testwiseness Study. 

Most of the groups receiving testwiseness training showed significant 
gains from pre- to posttest while the control groups (which .received no 
testwiseness) did not show significant gains. Therefore, we could conclude 
the gains in the testwiseness groups were 'due to testwisenei^s training 
and not to maturation, improved reading ability, etc. 
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To help you understand Tables 2-5: 

DOI = Degree Of Implementation: Each teacher either was contacted 
by phone or contacted' through a questionnaire and asked the 
y degree to which they implemented the project. 

N = Number Of Students: This is the number of ' students who 
participated in the TOT pretest and posttest. 

X =.the mean (or average) of the classroom. 

SD = the standard deviation of the scores in the classroom. 

^xy ~ correlation between the pretest and posttest . 

t = this is a value which is obtained as part of the t-test. 

p = (A) Probability Value: If this is a number less than or 
equal to .05, it ^ means that the students gained from 
' pretest to posttes-t. Any of the following numbers 

indicatied the students gained from pretest to posttest: 
.000, .048, .025, .001, .016,. .003, etc. 

(B) / It was expected that the p values .for students in the 
Control groups whould not indicate the students gained 
from pre- to posttest because they we're not: receiving 
TW instruction. The following numbers which, are larger 
than .05 indicate students in the Control groups did 
not make gains: .402, .906, .464, .082. 

In summary, in this NIE funded Testwiseness Project 1980-81 students 
demonstrated that they learned principles of testwiseness. Dr. Sabers' 
aind I thank you, the participating teacher^, for 'your voluntary partici- 
pation and we thank you,, the pri'ncipals at "participating schools, for 
your support. • ■ * ■ 



s'i^ncerely, 



Stephen" Powers and 
Darrell Sabers 

SP/ch ^ . 
1/5/82 ' 
Enclosure 



Copy to. Chris Crowder 



Teachers and Schools in the NIE 

1980-81 



Testwiseness Study 



Teacher 



School 



Third Grade 



Allen , Doreen 
Boerner , Shirley 
Conway , Ray • 
Cotrupe , Clara 
Darcy, Judith . 
Mai lams , Elizabeth 
Morrison, Carolyn 
Sarver, Marianne 
Smith, Loise 
Ward, Lopez 
Westenburg, JoAnne 



Davidson 
Hollinger 
Pueblo Gardens 
Lynn 

Pueblo Gardens 
Lawrence 
Safford 
White 

Pueblo Gardens 

Cavett 

Drachman 



Fifth Grade 



Campas , Gilbert 

Casey, Dbnna 

Dillard-Davis , Kathy 

Ditsworth, , Diane 

Gray, Virginia/Mr. Martinez 

Houston, Sharon 

Kareiva, Anne 

Regan, Peggy /Mr. Castillo 

Riggins, Vance 

Stoler, Nancy. 

Thomas, Frances 



Drachman 

Hollinger 

Lawrence 

Lynn 

Safford 

Pueblo Gardens 
Corbett' ^ 
Van Buskirk 
Holladay 
Pueblo Gardens 
White * 



Seventh-rEighth Grade 



6^agwell^ Terry 
Berry, Joann 

Born, Diana/Righardson, Gail 

Cross , 'Pat /-^^ 

Freiman , Lela 

Gordy, Mike 

KasulaitiS,- Rob 

Little, ^Al 

Nef f-Encina3 Julia 

Sizemore, Beverly 



Naylor 
, Wakefield 
Doolen 
Safford 
Naylor 
Pistor 
Safford 
Pistor 
Wakefield 
Naylor . 



■eric 
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DiTifion of PLANNING, ANAI^YSIS and MANAGEMENT 



TO: Christopher. Crowder, Assistant Director V / 

Testinq Services . ' 

^- ■ ■ 

FROM: ^ Stephen Powers ^ 

Research Specialist , * ' ^ ' • 

... • , ■ ■ ■ ,/. •'. ■ 

SUBJECT: Preliminary Findinqs of tKe Testwiseness Study 1980-81 

/' 

• • /. ' ^ . 

/' 

The National Institute of Education funded a study ($12,191.00) of testwiseness 
in the Tucson Unified School District for 1980-81. I was the principal inves- « 
tiqator and Dr. Darrel 1 Sabers of the Department of Educational^' Psychology , 
University of Arizona, was the consultant. One purpose of the study was to. 
implement instruction jn testwiseness to volunteering teachers and to observe 
any qains in students' test-tak;ing skills. 

1.1 order to measure testwiseness at Grades 3, 5, 7, and 8, a Test of Testwiseness 
(TOT) was constructed by Dr. Sabers and myself. The conceptual framework for; 
this test was the most recent research on testwiseness. There were two special 
problem's in the development of this test: (1) it had to be simple enough for 
third grade students and challenging enough for eighth gra'de students, and 
(2) 'the vocabulary should not be inordinately difficult because many of the stu- 
dents in this study would be minority students coming from elementary and junior 
hiqh^ schools of the TUSD where there was low achievement in reading'. A further 
question was, would the test of testwiseness detect changes in students' ability 
after instruction in testwiseness. . ' : . 

The Test of Testwiseness consisted of five items which measured risktaking in 
test-takinq conditions and 16. items which measured four aspects of testwiseness. 
The risktaking scale did^ not appear to be a sensitive or discriminating scale. 
The testwiseness scale did appear to successfully measure four aspects of 'test- 
wiseness. ' " 

Volunteer teachers 'were taught testwiseness principles in two one-hour sessions 
by. Dr. Sabers and myself, teachers then were asked to implement this instruction 
in their classrooms for a minimum of 15 minutes every two weeks fo^^^^^r months. 
Students were pretested and posttested with the Test of Testwiseness. 

Teachers implemented testwiseness instruction in their own ways in each classroom. 
For this preliminary analysis, I have analyzed each teacher's classroom of students 
seoarately, viewinq each group as an indeoendent replication of the treatment, • 
This method of analysis was important because I have promised each teacher that I 
v/ould reoort to them the results' of the study. 

Table 1 summarizes achievement in Testwiseness: 
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Table 1. Treatment and Control (Jroups Participating in the 
Testwiseness Study 1980-81* 





Treatment 


Control 


Grade 


Classes 


Students - 


Classes^ 


. fojdents 


3 


\S 

I 


154 


3 


49 


5 


- 9 


186 ■ 




' 30 


7 


17 


255 


'^4 


55 


8 


13 


125 






TOTAL 


47 : 
: 


720 


<• 

9 


134 



*Only students with pretest and posttest 5core are 
included in this analysis. - - " 

Of ^^the 47 classrooms receiving testwiseness instruction, 81 percent of the class- 
rooms .shov/ed significant gains from pre- to posttest. None of the Control Groups 
(those groups not receiving testwiseness instruction) showed si'gnificant gains . 
from pre- to posttest. Attached to this report are four tables giving detailed 
analysis of eacK classroom of students. Only .students who were pre- and pdsttested 
were included in the analysis. 

These results provide evidence for'som^e interesting conclusions: , 

1. .Testwiseness can be taught. ^ ^ ' . , ^ 

2. ^Testwiseness can be taught as early as the third grade. 

3. A test developed to measure testwiseness will detect 
chanqes resulting from testwiseness instruction. 

4. Students will not gain in test-taking skil Is^ simply by • 
maturation or development of other skills. But specific 
instruction in testwiseness can raise their testwiseness. 

These are only a few preliminary findings. I would like approval to communicate 
these results to^ administrators and participating teachers. 



SP/se 
12/2/81 • 
Attachments 



7j 



Table 2. Dependent' t-test Comparinn Pretest and Posttest Means of Each TW Participant Teacher's Classes 
at the Third Grade 



Teacher 










Pretest 


_Posttest 


r 






p 


number 


Test 


DOI^' 


. N 


V X 


SD 




SD ■ 


xy 




t 


1 


Risk 


2 


24 


4 


.83 




.56 


4.96 




,20' 


.06 


1 


.00 


.328 


Testwiseness 




24 


a 


.79 


1 


.86 


li.25 


1 


.73 


. 3|7 


5 




.UUU 


-- 


" ; Risk 




19 


4 


.84 




.37 


4.37 


1 


.21 


.38 


-1 


.84 


v083 ^ 


^ Testwiseness 


- 


19 


10 


.37 


1 


.53 


12.79 


2 


.42 , 


.51 


b 




. UUU 


6 


Risk . 


2 ' 


15 


4 


.47 


1 


.30 


5.00 




.QO 




1 


.59 


.135 




Testwiseness 




• 15 


7 


.87 


2 


.56 


9.33 


2 


.79 


.53 


2 


. 17 


. 048 


12 

\ 


Risk 


2 


23 


4 


.52 


'1 


.16 


4.91 




.417 


..28 


1 


68 


.107 


Testwiseness 




23 


10 


43 


1 


.31 


12.13 


. 1 


.14 


.45 


6 


28 


.000 , 




Risk 


1 


■ 15 


5 


00 




.00 


5.00 




.00 










■ \. 


Testwiseness 




15 


8 


33 


2 


.44. 


12.93 


1 


.58 


. 32 


7 




. UUU 


^ \33 

\ 


• Risk 


1 


18 


^ -A 


89 




.32 


4.00 


1 


.33 


.27 


' -2 


.95 


.009 


Tpcfv/i ^pnp^^ 




18 


10 


11 


1 


.81 


12 56 


2 


.33 


.58 


5 


33 


.000 


38 


Risk 


1 


16 


4 


50 


1 


.32 


5.00 




.00 


•k-k 


1 
1 






Testwiseness 




16 


9 


06 


2 


.14 


12.75 


1 


.57 


.32 


6 


67 


.000 „ 


\ 

39 


Risk 




24 


4 


50 


1- 


.41 


4.96 




.20 


- . u/ 


1 
1 


DO 




I 
I 

V 


Testwiseness 




■ 24 


8 


42 


o 

L 




9.42 


2 


.08 


.51 


2 


40 


. .025 


\ 

, I 

\ 








CONTROL 


GROUPS 














i 


11 


Risk 


4 


16 


4 


75 


1 


.00 


■4.94 




.25 


1.00 


1 


00 


.333: 


Testwiseness 




16 


9. 


06 


2 


64 


8.50 


2 


.25 ■ 


.44 „ 




86 


.402 ' 


_ 27 


Risk 


■ 4 


17 


4. 


65 




61 


3.88 


1.80 


-■'.33 


-1. 


52 


.149 


Testwiseness 




17 


9. 


12 


1 


54 


9.06 


2 


63 


. .65 




12 


.906 


, 35 \ 


Risk 


4 


16 


4, 


94 




25 


4.94 




.25 


- .07 




00 


1.000 ' 


Testwiseness 




16 


,8'. 


75/ 


3 


02 


9.06 


2 


08 


.85 




75 


.464 



*DOr is Denree of .Iniplemontatoon: Teachers were asked the denrGO to which they iniplenionted the Testwiseness 
(Project .(i = adequate, 2 = moderate^ 3 = slinht, 4 = no implementatioiO . , ^ 

rf^Cannot bb calculated. . ' i * . 



/ 



■Table 3. Dependent t-tesfls Comparing 
at the Fifth Grade 



Pretest and Posttest Means 'of Each TW Participant Teacher's Classes 



CD 

as 



ERIC 



Teacher 
Number 


Test j 


DOI* 


N 


Pretest 
X SD . 


Posttest 
; X SD 


r 

xy 


t 


P 




8 


Risk 1 
Testwiseness ' 


1 


15 
15 


4.33 
10.20 


1. 
2. 


76 
57 


4.80 
10.73 


.77' 
2.74 


. 68 
.52 


N 

1 . 33 
.,9 


. 204 
.443 




9 


\ 

Risk 

Testwi seness 


3 


18 
18 


5.00 
10.00 


l! 


00 
33 


5.00 
10.50 


.00 
1.15 


•k-k 

.31 


ick 

1.45 


.166 




15 


Risk 

Testwiseness 


1 

/ 


24 

24 


4.79 
7.50 


2! 


72 
30 


4.54 
9.67 


1. 14 
2.35 


.67 
.4l 


-1.45 
4.19 


. 162 
.000 


/ 


16 


Risk 

Testwiseness 


.. 1 


23 
23 


4. 17 
10.83 


1 

1. 


94 
50 


4; 39 
12.70 


1.27 
1.87 


. 05 
.40 


.68 
4.80 


c n/1 
. bU4 

.000 


/ 


22 


Risl< 

Testwiseness 


1 ■ 


23 
23 


3.96 
8.35 


1. 
2. 


58 
95 


3. 35 
11.13 


1 . 85 
2.47 


1 A 

. 14 
.14 


1 on 
- 1 . jU 

3.74 

f 


9nQ ' 
. ^Uo / 

.oor^ 




23 


Risk ^ • 
Testwi senes's 


2 


20 
20 


4.55 
10.15 


1 . 
2. 


28 
48 


b . UU 

10.70 


nn 

. UU 

2.15 


.22 


i . JO 

.85 


.409 




30 


Risk 


. 1 


17 
17 


4.06 
9.94 


1. 
1. 


34 
92 


5.00 
11.12 


.00 
2.17 


** 
.75 


? 89 
2.68 


.001 • 

■ !oi6: 




32 


Risk 

Testwi seness 


1 


19 
19 


5.00 
10.21 


2. 


00 
30 


5.00 

13.05 


.00 
2.2"5 


** 
.28 


' 4.53 . 


..OOOi 

I 




37 


Risk 

Testwi seness 


2 


27 

27 


4.89 
10.52 


1. 


32 


5.00 
12.22 


.'00 
2.76 


** 
.33 


1.80 
3.26 


.083 
.003 


/ 










CONTROL GROUP 














20 


Risk 

Testwiseness 


4 


15 
15 


; 5.00 
8.00 


3! 


'go 

21 


'4. .93 
8.73 


.26 
3.51 


•k-k 

.73 


-1.00 


. 334 1 

.919 

I 


83 


•3,6 


Risk 

Testwiseness 


4 


15 

15 ■ 


3.07 
7.47 


2. 
3. 


37 
07 


4.80 
7.93 


.56 
2.81 


-.15 
.51 


' ■ 2.66 

.62 


.019 
. 546 


1 
i 


*DOI is Derjree of Implementation: Teachers were 
Project (1 - adequate, 2 = moderate, 3 = slight, 
**Canr^t be caljcul^ted. • , 


asked th'a cleciree to wliich 
4 = no impleiiiontation). 


they implemented the Testwis 
• • • 


eness 

1 ; . 


• 



• • m m • # • • • 



Table 4. Dependent t-tests Comparing Pretest and Posttest Means of Each TW Participant Teacher's Classes 
at tlie Seventh Grade 



Teacher 










Pretest 


Posttest 








• Number 


Test 


Period 


DOI* 


N 


X 




SD 


X 




SD 




t 


P 






1 


2 


X U 




1 
i 






1 

X 


84 


.74 


1. 10 


.286 




Testwiseness 






18 


9.56 


2 


.15 


13,8.9 


1 


.18 


.42 


9.33 


.000 


J 








—J 
/ 


J • oo 


1 
i 






1 

i 


^n 


13 


.51 


.629 




Testwiseness 






' 7 


10.56 




.79 


12.29 


1 


.98 


^.44 


1.87 


.111 


J 


Pi Qk 


c; 




77 


4. 44 




. / J 


/] nn 
4 J UU 


1 

i 


c; n 
. bU 


57 


-1 08 


t sJ XL. 




Tqstwi seness 






9 


10.44 


2 


.79 


12.78 


3 


.38 


■ .78 


3.30 


■.Oil 


c 
D 


K 1 SK 


0 




0 


4.89 




. 33 


4. 78 




. 44 


- 1 Q 




• 0 j4 




Testwi seness 






9 


8.67 


2 


.24 


11.56 


2 


.45 


.13 


2.80 


,023 


1 0 


K 1 S K 


/I * 




1 7 


4.71 




. 59 


5 . 00 




. 00 




9 n^ 

c . UD 


. UOD 




Testvn' seness 






17 


9.53 


2 


.87 


,12.65 


1 


.62 


.39 


4.78 


.000 


1 Q 
1 J 


Kl SK 


0 




1 '3 


3.31 


" 1 


.84 


4. 77 




. 60 


'5n 
. jU 




ni 1 

. U i i 




Testwi seness 






13 


10.62 


1 


56 


11.38 


1 


.98 


.70 


' 1.95 


.075 


1 7 


K 1 5 K 












nn 


^ nn 




nn 
uu 


■kk 


** 


** 




'Testwiseness 


> 




4 


10.25 


2 


06 


13.25 


1 


.50 . 


.51 


3.29 


.046 


25 


Risk 


5 


2 


23 


J . J 


1 
i 


0 J 


/I 7/1 




7^ 


, .46 


4.59 


.000 




Testwiseness 






23 


11.17 


1 


82 


12.70 


2 


32 


-.30 


2;i7 


.041 


25 


Risk 


6. 


2 


- 14 


4.71 




61 


4.86 




53 


• .34 


.81 


.435. 




Testwiseness 






14 


■ 93 


1. 


77 


11.21 


1. 


19 


.40 


2.19 


.048 


28 


Risk 


1 


1 . 


14 


4 79 




80 


4.43 


1. 


45 


-.11 


.77 


.455 




Testwiseness 






14 


9.54 


2: 


56 


11.93 


2. 


89 


.60 


3.47 


.004 


28 


Risk 


2 


^ 1 


21 


5.00 




00" 


4.33 


1. 


68 


** 


1.81 


.085 




Testwi seness 






21 


9.95 


3. 


U 


11.05 


3. 


32 


.73 


2.14 


.045 c 



ERIC 



8'4 . 



Table 4. (contd. ) 



00 



Teacher 

Number' 


Test 


Period 


DOI* 


N 


Pre.test 
X SD 


Posttest , 
X SD 




- t 


< 


31 


Risk 

Testv/iseness 


1 


1 • 


23 
23 


5.00 
9.39 


.00 
1.50 


4.96 
12.83 


.21 

2.06 


** 
.38^ 


-i.oa 

8.07 


.328 
■ ^ .000- 


31 


Risk ' 
Testwiseness 


2 


1 


16 
16 


'4.37 
.10.12 


.96 
2.06 


4 . 81 
, 12.75 


.75 
, 2.16- 


.10 

' .50 


1.52 
4. "94 


■ . 150 
.000 


. 31 


• Risk 
Testwiseness 


3 


1 


13 
13 


4.54 
10.08 


1.13 
2.60 


4.62 
12.69 


.96 

2.90 


; --18 
.34 


.17 

.2.97 


.866 
.012 


31 


* Risk 
Testwiseness 


4 


1 


22 
22 ■ 


4'. 64 
10.27 


^.790 
1.39 


4.91 
11.91 


■ .29 
2.65 


.2-6 

.20 


1.67 
2.81 


.110' 
.011 


• 31 


^Risk 

Testwiseness 


5 


1. 


21 
21 


4.76 
9.90^ 


.89 
1.55 


5.00 
12.71 


■ .'00 
2.19 


** 
.17 


1.23 
5.23 


r .234 
.000 


34 


Risk 

Testwiseness 


1 - 

•3 


3 


12 
12 


■«4.58 
10.92 


1.00/ 
1.31 ■ 


J' ^ 

5.00 

12.08 


.00 
. 1.56 


.36 


1.45 
2.46 


.175 - 






• 


CONTROL GROUPS 






' ! 






■ 5 


Risk 

Testwiseness 


4 


4 


15 

. 15 


4.93 
10.60 . 


.26 
1.80 


3.00 
10.27 


' 2.27 
. 2.31 


-.12 
.63 


-3.24 
- .70 


.001 

^ .494 




Risk 

Testwi seness 


2 


4 


11 " 


5.00 
9.36 


.00 
2.29 

1 


5.00 
10.64 


.00 
2.94 


.30 


1.35 


.210'. 




Risk 

. Testwiseness 


6 


4 


7 

7 


5.00 
9.57 


.00 
1.40 


5.00 
11.00 


.00 
1.63 


** 
.29 


** 
2.09 


** 
.082 


, 25 


Risk 

Testwiseness 


4 


4 ^ 


22 
22 


■4.54 
9.36 


1.01 
2.10 


4.82 
9.59 


.50 
2.82 


.5B 

.43 


1.55 
.39 


.-137 
.70(f<^' 



*DOl is Degrt^ee of Implementation: Teachers v/ere 
Project (i = adequate, 2 = moderate, -3 = slicjht; 
**Cannot be calculated. 



asked the degree to which they implemented the Testwiseness 
4 = no implementation). 



Table's. Dependent t-tests Comparing 
at the Eighth Grade 



Pretest and Posttest Means of Each TW Participant Teacher's Classes 



Teacher 








Pretest 


Posttest 








Number 


Test 


Period DOI* 


N 


X 




SD 


X 


SD 


r 

xy 


t 


p 


3 


■ Risk " 


3 1 


15 


3.87 


-"l 


.77 


■ 4.93 


.26 


-.18 


2.26 


.041 




Testwi seness 




1 C 

ib 


11. dl 


1 


Id 

. /y 


13. dU 


1 . yb 


9Q 
. CO' 


H . uu 


. uu i 


' 3 


4 

Risk ■ 


4 1 


11 


5.00 




.00 


5.00 


.00 










Testwi sen&ss 




1 1 


10. 55 


1 


.81 


14.27 


1 'O "7 

1.27 


- . U/ 


D . 4 i 


. uuu 


3 


Risk 


6 1 


14 ' 


4.86 




.53 


4.86 


.53 


-.08 


.00 


1.00 




Testwiseness 




1 A 


10. iiy, 


1 




1 J. /I 


i . Oh 


- . lO 


D . Do 


nnn 
. uuu 

•> 


o 

13 


Risk ,^ 


1' 1 


.13 


. 4.54 


1 


.39 


4.92 


.28 


.98 


1.2,4 


.240 




Testwi seness 






y . by 


9 
c 


. ^ D 


iU. D4 


C. . CO 


. 3U 


1 nQ 

1 . U-7 




• 13 • 


■ Risk 


2 1 


10 


5. 00 




.00 


4.80 


.42 


■kit 


^-1.50 


.168 




•Testwiseness 




10 


9.30 


2 


.31 


12,00 


1.70 


-.31 


2.61 


.028 


13 


Risk 


5- 1 


12 


4.58 


1 


.16 


4.75 


.62 


-.16 


• .41 


.689 




. Testwiseness 




12 


10.17 


1 


33 


12.67 


1.97 


-.32 


3.19 


.009 


17 


Risk ■ ' 


6 1 


5 


4.60 




55 


5.00 


.00 


** 


1.63 


.178 




Testv/i seness 




5 


8.40 


1. 


52 


15.00 


1.41 


.82 


16.50 


.000 


24 


• Risk 


1 1 


6 


5 ."00" 




00 


5.00 


.00 


** 








Testwiseness 




6 


10.00 


L 


79 


13.33 


1.37 


-.41 


3.07 


.028 


24 


Risk 


2 .1 


5 .• 


5.00 




00 


5.00 


.00 


** 


■k-k 


** 




Testwi seness 




5 


10.80 


li 


79 


11.40 


5.81 


-.69 


.19 


.861 1 



00 



ERIC 



83 



89. 



o 



Table 5. (contd. ) 



Teacher 










Pretest 


_Posttest 


r 










Toe t 


Pprlorl 
r c f 1 uu 


DO I* 




X 


SD 


X 


SD 


xy 




t 


P 






• 


1 


7 


5.00 


.00 


4.86 


.38 


' ** 


-1 


.00 


. .356 




Testwiseness 






7 


9.71 


1.80 


12.57 


1.72 


.65 


5 


.16 


.002 


24 . 


Risk 


6 


1 


7 


4.86 


.38 


5.00 


.00 


** 


1 


.00 


.356 




Testwiseness 






7 


10.29 


1.80 


12.00 


1.83 


. .41 


2 


.30 


.061 


28 


Risk 


3 ' 


1 


16 


4:69 


1.01 


4.94 


.25 


-.08 




.94 


.362 




Testwiseness 






15 


10.56 


2.39 


13.56 


2.25 


.44 


4 


.90 


. -.000 


28 


Risk 


4 


1 


4 


4.75 


.50 


5.00 


.00 


** 


1 


.00 


.391 




Testwiseness' 






4 


11.25 


1.26 


13.00 


.82 


-.32 


2 


.05 


.133 



*DOI is Degree of Implementation: Teachers were asked the degree to which they implemented the Testwiseness 
Project (1 = adequate, 2 = moderate, 3 = slight," 4 = no implementation). 



**Cannot be calculated. 

NOTE: There were no control groups for eighth grade students. 



r-. 

0\J 




APPENDIX 5., 

Repeated Measures 
Analys.is of Variance on Reading Comprehension 
* Scores 



9-^ 



93^ 



Table 1. Two Factor Repeated Measures ANOVA on Reading Comprehensidn 
with Third Grade Students* 



Source of Variation' 



df 



MS 



P . 



Between subjects 

Ethnicity (E) 
Subj w. groups 



3 ^^3.59 3.97 
103 21.04 



.010 



Within subjects 

Reading (R) 
RE 

Rx sub w. groups 



' 1 
3 

103 



35.09 
5.35 
4.28 



8.19 
1 .25 



.005 
.296 . 



*A1 though a three" factor Repeated Measures ANOVA was planned for th,e 
third grade, the high SES Native American cell did not have any cases 
Therefore, the three factor analysis could not be completed. 



Table 2. Three Factor Repeated Measures ANOVA on Reading Comprehension 
with Fifth Grade Students ~ ^ ' . i 



Source of Variation 



df 



MS ■• 



Between subjects 

Ethnicity (E) 
SES (S) . 
' ES 

Subj w. groups 



■ 3 
1 

3 

171 



924.48 
269.50 
--18.63 
,138.20 



6.69 

1 .as 

.1*3 



.000 
.164. 
.939 



Within subjjects 
Reading' .(R) 
RE i ^ 
RS - . 

-RiES^ ' 
RX' sub w. ' groups 



1 

3 

T 
I 

3 



.76 
21 .32 
4.33 
1 1 . 31 
. a. 36 



.09 
2.55 

.52 
1 .35 



.763 
.057 
.473 
.25^ 



Table 3. * Three Factor Repeated Measures ANOVA on Reading Comprehension 
with Seventh Grade Students * 



Source of Variation 



df 



.MS 



Between si^bjects 
Ethnicity (E) 



SES (S) 
ES 

Subj w 



in subjects 



Readi n 
RE 
RS 
RES 

RX sub 



groups 



w 



groups 



3 
"1 
3' 
191 



800.58 
.40 
136.43 
■118.°80 



1 


' ,5,57 


3 


17.10 


1 


.10 


3 


"9.59 


191 


11 .99 



6.74 .000 
.00 .954 
1.15 .331 



.46 .4'96 

1.43. .237 

.01 .'926 

.80 .496 



/ 



Tabled. Des^cHptJve Statistics of Third Grade Students by 

Etbnicity^and^-Timft (Pretest/Post^st) on Reading 

'Comprehension 



Ethnicity 



Pretests 
N.; ' Mean ^ 



SD 



Posttest 
Mean SD 



Total 
Mean^ 



Native American 
Black 
Hispanic 
An^TS 

i J M 



5 ■ 3h.77 3.62 34.1 2 2.28 



15, -3^.59 3.93 



51 
36 



-3b'.79 3.27 
37.03' 'i-.I6 



35 . 93 
36 .00 
'37.83 



3.53 
3.53 
■ 3.30 



32.95 
35.26 

•35. .00 

f 

37.^-^ 




3-5.^5 



36.52 



Table- 5 



Descriptive Statistics of Fifth Grade Stuints by 
Ethnicity and Time .(Pretest/Posttesthon Reading 
Comprehension. ^ 



TOTAL 



179 ' 45.88 



46.52 



36. 1<^ 



Ethnicity—, 


N 


Pretest 
Mean 


SD 


Posttest 
Mean SD 


Total 
Mean 


Native American 


3 ■ 


43 .76 


5.04 


41 .44 

< 


3.67 . 


42.60 


c 

Black 


6 


34,f80 


3.25 


36,54 


4.05 


35.67- 


RT^panic , 


98 


43.63 


7.74 


44.61 


8.50 


44.11 


An>^lq 


72 ; 


,49.98 


9 = 97 • 


50,]/5 


9.15 


50.06 



46.20 



96 



Table 6. Descriptive Statistics of Seventh Grade Students by 
Ethnicity and Time (Pretest/Posttest ) on Reading 
Comprehension. 



Pretest Posttest Total 



Ethnicity 


N 


Mean 


SD 


Mean 


SD 


Mean 


Native American 


7 


43. 


58 


8 


.79 


41 


47 


6 


.65 


42. 


53 


Black 


14 


43 


72 


7 


.92 


43 


.71 . 


7 


.31 


43 


72 


Hispanic 


107 ^ 


43 


73 


7 


.26 


46 


.02 


7 


.74 . 


. 44 


88 


Anglo 


71 : 


50 


.73 


9 


.31 


51 


.75 


8 


.81 


51 


.24 


TOTAL." 


199 


46 


.23 






47 


.74 






46 


.98 
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